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CK  THE  USE  CF  FISHER'S  LINEAR 
DISCRIMINANT  FOR  IMAGE  SBCHEMIACFICM 


1.  Introduction 

The  a|)plicatlon  of  siqpervised  and  unsupexvised  clasalflcatlcn  technique 
for  image  segmentation  by  oonputer  has  received  iruch  attention  within  the  last 
few  years  (see  e.g.  J3]).  In  this  r^rt  further  segmentation  results 

are  presented  on  infrared  and  reconnaissance  images  using  statistical  pattern 
recognition  msthod. 

The  available  pictorial  data  are  seme  pieces  of  infrared  {hotographs  and 
one  piece  of  aerial  photogr^  for  reconnaissance  applications.  Each  infrared 
image  considered  contains  64x64  points  with  256  possible  gray  levels,  and  the 
aerial  photo  contains  300x400  points  with  same  possible  gray  levels.  Each  pio> 
ture  is  stored  in  the  magtcqpe  line  by  line.  The  coiputer  segmentation  is  pei> 
formed  at  the  PDP  11/45  minioonputer. 

2,  Algoritbro  and  Definitions 

A  general  introduction  to  the  Fisher's  linear  discriminant  analysis  is  in 
[3],  [4].  Let  X  be  a  matrix  measurement  and  X^,  i  >  1,2  be  the  caollection  of 
n^  maasuraments  belonging  to  the  ith  class.  The  two  classes  ccnsidared  are  the 
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Then  the  Flaher's  lixiear  dlscriininant  ooifutes 
y  -  W'X  Wq 

lihere  W  »  weight  matrix 

■  on  S“^  (m^  «  m^)  ;a  is  an  arbitrary  ocnstant. 

■  threshold  wsl^t 

■  -M»W 

Dedslcn  is  to  choose  class  1  i  f  Y  0  and  Class  2  otherwise. 

Now  oonslder  the  extension  to  noisy  scenes.  Let  the  noisy  image  be 
x(i,j)  =  S{i,j)  +  n(i,j) 

where  S(«)  and  n(*)  axe  the  original  image  and  noise  respectively.  The 
presence  of  cbservatlcn  noise  (assuied  to  be  additive  white  Gaussian  with 
varlanoB  1}  creates  a  probability  distribution  of  gray  levels  in  the  back¬ 
ground  as  well  as  in  the  object.  That  is  the  object  and  the  background  gray 
levels,  Instead  of  being  constant,  are  normally  distributed  with  ocnroan 
variance  1  and  means  M  and  0,  respectively.  Definition  of  the  theoretioal 
error  probability  as  given  in  [5]  is 


Misre  u  =  norm  of  [n(Mj^  -  Mj)  -  M^)] 

■  norm  of  A 

■  (dimension  of  A).  j|  (aee  e.g. [6]) 

The  8lgnal-to>nolse  ratio  is  defined  as 

S  _  “s 
R  noise  variance 


where  the  noise  is  Gaussian  distributed  with  variance  1  and  zero  mean 
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Other  definition  of  liJce, 

2 

g  •  noise  standard  deviation) 

M  *  noise  variance 

toBY  not  be  appropriate  to  these  image. 

.  Experiments 

3.1  Segnentation  of  the  Alabama  data  base  ixvtrared  images;  Table  la 

describes  the  nxnber  sequenoe  of  sub-pictures  of  Figures  1  &  2.  Figure  la 

is  the  original  inege  and  noisy  images  with  different  magnitude  Gaussian 

noise  added.  Figure  lb  is  classlfloaticn  results  using  fixed  wei^  matrix. 

in  [3].  Figure  Ic  is  classification  results  using  unfixed  vieight  matrix  which 

dependlon  each  sub-picture.  Figure  2  is  same  as  Figure  1  except  that  targets 

are  one  tank  and  one  jeep.  Percentage  of  errors  for  noisy  images  and  theareti- 

oal  value  are  tabulated  in  Table  lb.  Figure  3  is  the  relationship  between  the 

s 

peroenteige  (%)  of  errors  and  the  signal-to-noise  ratio  (^)  for  the  one  target 
(upper  figure)  and  the  two  targets  (lowsr  figure) .  The  object  boundaries  can 
be  ocnpletely  extracted  frcm  se^nented  images  by  using  the  cross  (Robert)  gra¬ 
dient  and  Sobel  operator  [7]  as  shown  in  Figure  4. 

3.2  Segmentation  of  the  reoonnaissanoe  images.  A  diagram  that  illustrates 

the  selection  of  learning  samples  is  given  in  Fig\ue  5.  Figure  fo  is  the  origi¬ 
nal  image  (256  x  256}  with  thre^Id  »  150.  Figure  6b,  6c  are  classified 
results.  In  Figure  6c,  samples  are  taken  from  regions  ni,  I,  respec¬ 

tively.  Because  of  the  gray  level  distribution  in  region  H,  the  classified 
result  given  by  Figure  6c  is  better  than  Figure  6b.  Figure  7,8  and  9  include 

e 

additive  white  Gaussian  noise  with  varianos  1  and  zero  mean;  ^  axe  0.2,  1.0, 2.0 
xei^sctively.  In  these  three  sets  of  figures,  b  and  c  are  classified  results  by 
using  fixed  weight  matrix,  d  and  e  axe  classified  results  by  using  weight  matrix 


which  depends  on  each  image.  By  following  the  same  pxoceduxe  to  segment  the 
whole  image  (300  x  400) ,  the  results  are  shown  in  Figure  10  to  Figure  13. 


4.  Conclusion 


These  results  suggest  that  the  Fisher's  linear  discriminant  performs 
very  effectively  in  pixel  classification  and  image  segientation.  The 
classified  results  ccnpare  very  favorably  with  theoretical  analysis.  How¬ 
ever,  the  results  are  somewhat  dependent  upcn  the  selection  of  learning 
saiples.  Further  study  will  be  made  in  using  unsvpervised  classification 
techniques  for  inege  segmentation. 
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Further  experimental  results  are  reported  on  the  use  of  Fisher's  linwAt-  dis¬ 
criminant  for  segnentatlcn  of  infreued  images  and  rsoonnedssanoe  Images. 
Iheoretical  error  probability  oonputed  oorpares  very  favorably  with  tto 
experimental  peroentage  mlsclasslfication. 
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